Stochastic Curtailment in Adaptive Mastery Testing: Improving the Efficiency of Confidence Interval–Based Stopping Rules
نویسندگان
چکیده
A well-known stopping rule in adaptive mastery testing is to terminate the assessment once the examinee’s ability confidence interval lies entirely above or below the cut-off score. This article proposes new procedures that seek to improve such a variable-length stopping rule by coupling it with curtailment and stochastic curtailment. Under the new procedures, test termination can occur earlier if the probability is high enough that the current classification decision remains the same should the test continue. Computation of this probability utilizes normality of an asymptotically equivalent version of the maximum likelihood ability estimate. In two simulation sets, the new procedures showed a substantial reduction in average test length while maintaining similar classification accuracy to the original method.
منابع مشابه
Frequentist evaluation of group sequential clinical trial designs.
Group sequential stopping rules are often used as guidelines in the monitoring of clinical trials in order to address the ethical and efficiency issues inherent in human testing of a new treatment or preventive agent for disease. Such stopping rules have been proposed based on a variety of different criteria, both scientific (e.g. estimates of treatment effect) and statistical (e.g. frequentist...
متن کاملApplication of Sequential Probability Ratio Test to Computerized Criterion-Referenced Testing
The adaptive testing is an important testing method in the modern educational/psychological testings. In adaptive mastery testing, the items are selectly adaptively according to the estimated information of the unknown latent ability levels, and given then to the test-takers, sequentially. Hence, the decision (master or non-master; pass or fail) for each test-taker is made sequentially based on...
متن کاملTwo-stage Stopping Procedures Based on Standardized Time Series
We propose some new two-stage stopping procedures to construct absolute-width and relative-width confidence intervals for a simulation estimator of the steady-state mean of a stochastic process. The procedures are based on the method of standardized time series proposed by Schruben and on Stein’s two-stage sampling scheme. We prove that our two-stage procedures give rise to asymptotically valid...
متن کاملExact hypothesis testing and confidence interval for mean of the exponential distribution under Type-I progressive hybrid censoring
Censored samples are discussed in experiments of life-testing; i.e. whenever the experimenter does not observe the failure times of all units placed on a life test. In recent years, inference based on censored sampling is considered, so that about the parameters of various distributions such as normal, exponential, gamma, Rayleigh, Weibull, log normal, inverse Gaussian, ...
متن کاملHeuristic Rules for Improving Quality of Results from Sequential Stochastic Discrete-Event Simulation KRZYSZTOF PAWLIKOWSKI, DONALD MCNICKLE and JONG-SUK
Sequential analysis of output data during stochastic discrete-event simulation is a very effective practical way of controlling statistical errors of final simulation results. Such stochastic sequential simulation evolves along a sequence of consecutive checkpoints at which the accuracy of estimates, usually conveniently measured by the relative statistical error, defined as the ratio of the ha...
متن کامل